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' Computers are physical systems: what they can and cannot do is dictated 

ff^ ! by the laws of physics^ In particular, the speed with which a physical 

^ . device can process information is limited by its energy^^"^^ and the amount of 

^ ■ information that it can process is limited by the number of degrees of freedom 

0^ I it possesses^"^'^. This paper explores the physical limits of computation as 

^ ! determined by the speed of light c, the quantum scale h and the gravitational 

5^. constant G. As an example, quantitative bounds are put to the computational 

P5 ■ power of an 'ultimate laptop' with a mass of one kilogram confined to a volume 

^ ' of one liter. 
CT'i 

I Over the past half century, the amount of information that computers are capable 

>■ . 

k3( ' processing and the rate at which they process it has doubled every two years, a phe- 

j_j ■ nomenon known as Moore's law. A variety of technologies — most recently, integrated 

■ ■ ■ ' circuits — have enabled this exponential increase in information processing power. There 
is no particular reason why Moore's law should continue to hold: it is a law of human 
ingenuity, not of nature. At some point, Moore's law will break down. The question is. 
When? Extrapolation of current exponential improvements over two more decades would 
result in computers that process information at the scale of individual atoms. Although 
an Avogadro scale computer that can act on 10^^ bits might seem implausible, prototype 
quantum computers that store and process information on individual atoms have already 
been demonstrated^^ Although existing quantum computers are small and sim- 
ple, able to perform a few hundred operations on fewer than ten quantum bits or 'qubits,' 
the fact that they work at all indicates that there is nothing in the laws of physics that 
forbids the construction of an Avogadro- scale computer. 
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The purpose of this article is to determine just what hmits the laws of physics place 
on the power of computers. At first, this might seem a futile task: since we don't know 
the technologies by which computers one thousand, one hundred, or even ten years in the 
future will be constructed, how can we determine the physical limits of those technologies? 
In fact, as will now be shown, a great deal can be determined concerning the ultimate 
physical limits of computation simply from knowledge of the speed of light, c = 2.9979 x 10^ 
meters per second, Planck's reduced constant, h = 1.0545 x 10~^^ joule seconds, and the 
gravitational constant, G = 6.673 x 10~^^ meters cubed per kilogram second squared. 
Boltzmann's constant, kB = 1.3805 x 10~^^ joules per degree Kelvin, will also play a key 
role in translating between computational quantitites such as memory space and operations 
per bit per second, and thermodynamic quantitites such as entropy and temperature. This 
article reviews previous work on how physics limits the speed and memory of computers 
and presents new results: the derivation of the ultimate speed limit to computation, the 
trade-offs between memory and speed, and the analysis of the behavior of computers at 
physical extremes of high temperatures and densities are novel except as noted. 

Before presenting methods for calculating these limits, it is important to note that 
there is no guarantee that these limits will ever be attained, no matter how ingenious 
computer designers become. Some extreme cases such as the black-hole computer described 
below are likely to prove extremely difficult or impossible to realize. Human ingenuity has 
proved great in the past, however, and before writing off physical limits as unattainable, one 
should realize that certain of these limits have already been attained within a circumscribed 
context in the construction of working quantum computers. The discussion below will note 
obstacles that must be sidestepped or overcome before various limits can be attained. 

1. Energy limits speed of computation 

To explore the physical limits of computation, let us calculate the ultimate compu- 
tational capacity of a computer with a mass of one kilogram occupying a volume of one 
liter, roughly the size of a conventional laptop. Such a computer, operating at the limits 
of speed and memory space allowed by physics, will be called the 'ultimate laptop.' 

First, ask what limits the laws of physics place on the speed of such a device. As will 
now be shown, to perform an elementary logical operation in time At requires an average 
amount of energy E > TiTi/2/S.t. As a consequence, a system with average energy E can 
perform a maximum of 2E/'k% logical operations per second. A one kilogram computer 
has average energy E = mc^ = 8.9874 x 10^^ joules. Accordingly, the ultimate laptop can 
perform a maximimum of 5.4258 x 10^° operations per second. 
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1.1 Maximum speed per logical operation 

For the sake of convenience, the ultimate laptop will be taken to be a digital computer. 
Computers that operate on non-binary or continuous variables obey similar limits to those 
that will be derived here. A digital computer performs computation by representing in- 
formation in the terms of binary digits or bits, which can take the value or 1, and then 
processes that information by performing simple logical operations such as AND, NOT 
and FANOUT. The actual physical device that performs a logical operation is called 
a logic gate. The operation, AND, for instance, takes two binary inputs X and Y and 
returns the output 1 if and only if both X and Y are 1; otherwise it returns the output 
0. Similarly, NOT takes a single binary input X and returns the output 1 if X = and 
if X = 1. FANOUT takes a single binary input X and returns two binary outputs, 
each equal to X. Any boolean function can be constructed by repeated application of 
AND, NOT and FANOUT. A set of operations that allows the construction of arbitrary 
boolean functions is called universal. The actual physical device that performs a logical 
operation is called a logic gate. 

How fast can a digital computer perform a logical operation? During such an opera- 
tion, the bits in the computer on which the operation is performed go from one state to 
another. The problem of how much energy is required for information processing was first 
investigated in the context of communications theory by Levitin^^"^^, Bremermann^^"^^, 
Beckenstein^°~^^ and others, who showed that the laws of quantum mechanics determine 
the maximum rate at which a system with spread in energy AE can move from one dis- 
tinguishable state to another. In particular, the correct interpretation of the time-energy 
Heisenberg uncertainty principle AEAt >his not that it takes time At to measure energy 
to an accuracy AE (a fallacy that was put to rest by Aharonov and Bohm^^~^^) but rather 
that that a quantum state with spread in energy AE takes time at least At = 7rh/2AE to 
evolve to an orthogonal (and hence distinguishable) state^^"^^. More recently, Margolus 
and Levitin-'^^"-'^^ extended this result to show that a quantum system with average energy 
E takes time at least At = 7rh/2E to evolve to an orthogonal state. 

1.2 Performing quantum logic operations 

As an example, consider the operation NOT performed on a quantum bit or 'qubit' 
with logical states |0) and (For readers unfamiliar with quantum mechanics, the 

'bracket' notation | ) signifies that whatever is contained in the bracket is a quantum- 
mechanical variable; |0) and |1) are vectors in a two-dimensional vector space over the com- 
plex numbers.) To flip the qubit, one can apply a potential H = Eq\Eq){Eq\ + Ei\Ei){Ei\ 
with energy eigenstates |£^o) = (l/v^)(|0) + |1)) and \Ei) = (l/v^)(|0) - |1)). Since 
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|0) = {1/^/2){\Eq) + l^i)) and |1) = {1/^/2){\Eq) - each logical state |0), |1) has 

spread in energy AE' = (^^i — Eq)/2. It is easy to verify that after a length of time 
At = 7r^/2A£' the qubit evolves so that |0) — > |1) and |1) — > |0). That is, applying the 
potential effects a NOT operation in a time that attains the limit given by quantum me- 
chanics. Note that the average energy E of the qubit in course of the logical operation is 
(0|iy|0) = = {Eq + Ei)/2 = Eq + AE. Taking the ground-state energy Eq = 

gives E = AE. So the amount of time it takes to perform a NOT can also be written 
At = 7rh/2E. It is straightforward to show^^~^^ that no quantum system with average 
energy E can move to an orthogonal state in a time less than At. That is, the speed with 
which a logical operation can be performed is limited not only by the spread in energy, 
but by the average energy. This result will prove to be a key component in deriving the 
speed limit for the ultimate laptop. 

AND and FANOUT can be enacted in a way that is analogous to the NOT operation. 
A simple way to perform these operations in a quantum-mechanical context is to enact 
a so-called Toffoli or Controlled-Controlled-A'"OT operation^-*^. This operation takes three 
binary inputs, X, Y, and Z and returns three outputs, X', Y', and Z'. The first two inputs 
pass through unchanged: X' = X, Y' = Y. The third input passes through unchanged 
unless both X and Y are 1, in which case it is flipped. This is universal in the sense 
that suitable choices of inputs allows the construction of AND, NOT, and FANOUT. 
When the third input is set to zero, Z = 0, then the third output is the AND of the first 
two: Z' = X AND Y. So AND can be constructed. When the first two inputs are 1, 
X = y = 1, the third output is the NOT of the third input, Z' = NOT Z. Finally, when 
the second input is set to 1, y = 1, and the third to zero, Z = 0, the first and third output 
are the FANOUT of the first input, X' = X, Z' = X. So arbitrary boolean functions can 
be constructed from the Toffoli operation alone. 

By embedding a Controlled-Controlled-A'"OT gate in a quantum context, it is straight- 
forward to see that AND and FANOUT, like NOT, can be performed at a rate 2E/'Kh 
times per second, where E is the average energy of the logic gate that performs the oper- 
ation. More complicated logic operations that cycle through a larger number of quantum 
states (such as those on non-binary or continuous quantum variables) can be performed at 
a rate E/irh — half as fast as the simpler operations'^" Existing quantum logic gates 
in optical-atomic and NMR quantum computers actually attain this limit. In the case of 
NOT, E is the average energy of interaction of the qubit's dipole moment (electric dipole 
for optic-atomic qubits and nuclear magnetic dipole for NMR qubits) with the applied 
electromagnetic field. In the case of multi-qubit operations such as the Toffoli or simpler 
two bit Controlled-A'"OT operation, which fiips the second bit if and only if the first bit 
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is 1, £■ is the average energy in the interaction between the physical systems that register 
the qubits. 

1.3 Ultimate limits to speed of computation 

We are now in a position to derive our first physical limit to computation: energy 
limits speed. Suppose that one has a certain amount of energy E to allocate to the logic 
gates of a computer. The more energy one allocates to a gate, the faster it can perform 
a logic operation. The total number of logic operations performed per second is equal to 
the sum over all logic gates of the operations per second per gate. That is, a computer 
can perform no more than 

1/Ati < 2E£/7rh = 2E/7rn (1) 
£ e 

operations per second. In other words, the rate at which a computer can compute is limited 
by its energy. (Similar limits have been proposed by Bremmerman in the context of the 
minimum energy required to communicate a bit"^^""^^. These limits have been criticized, 
however, for misinterpreting the energy-time uncertainty relation^^, and for failing to take 
into account the role of degeneracy of energy eigenvalues-^^"-^^ and the role of nonlinearity 
in communications^"^.) Applying this result to a one kilogram computer with energy 
E = m(? = 8.9874 x 10^^ joules show that our ultimate laptop can perform a maximum 
of 5.4258 X 10^° operations per second. 

1.4 Parallel and serial operation 

An interesting feature of this limit is that it is independent of computer architecture. 
One might have thought that a computer could be sped up by parallelization, i.e., by taking 
the energy and dividing it up amongst a large number of subsystems computing in parallel. 
This is not the case: if one spreads the energy E amongst N logic gates, each one operates 
at a rate ^E/ttUN. The total number of operations per second, N2E/'k%N = 2E/7rh, 
remains the same. If the energy is allocated to fewer logic gates (more serial operation), 
the rate 1 / Atg at which they operate and the spread in energy per gate AE^ go up. If the 
energy is allocated to more logic gates (more parallel operation) then the rate at which 
they operate and the spread in energy per gate go down. Note that in this parallel case, the 
overall spread in energy of the computer as a whole is considerably smaller than the average 
energy: in general AE = -y/^^ AE^ Vn AEi while E = Y^Ei NEg. Parallelization 
can help perform certain computations more efficiently, but it does not alter the total 
number of operations per second. As will be seen below, the degree of parallelizability of the 
computation to be performed determines the most efficient distribution of energy among 
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the parts of the computer. Computers in which energy is relatively evenly distributed over 
a larger volume are better suited for performing parallel computations. More compact 
computers and computers with an uneven distribution of energy are better for performing 
serial computations. 

1.5 Comparison with existing computers 

Conventional laptops operate much more slowly than the ultimate laptop. There are 
two reasons for this inefficiency. First, most of the energy is locked up in the mass of 
the particles of which the computer is constructed, leaving only an infinitesimal fraction 
for performing logic. Second, a conventional computer employs many degrees of freedom 
(billions and billions of electrons) for registering a single bit. From the physical perspective, 
such a computer operates in a highly redundant fashion. There are good technological 
reasons for such redundancy: conventional designs rely on redundancy for reliability and 
manufacturability. In the present discussion, however, the subject is not what computers 
are but what they might be. The laws of physics do not require redundancy to perform 
logical operations: recently constructed quantum microcomputers use one quantum degree 
of freedom for each bit and operate at the Heisenberg limit At = 'Kh/2/S.E for the time 
needed to flip a bit^^~^^'^^~®°. Redundancy is required for error correction, however, as 
will be discussed below. 

In sum, quantum mechanics provides a simple answer to the question of how fast 
information can be processed using a given amount of energy. Now it will be shown that 
thermodynamics and statistical mechanics provide a fundamental limit to how many bits 
of information can be processed using a given amount of energy confined to a given volume. 
Available energy necessarily limits the rate at which computer can process information. 
Similarly, the maximum entropy of a physical system determines the amount of information 
it can process. Energy limits speed. Entropy limits memory. 

2. Entropy limits memory space 

The amount of information that a physical system can store and process is related to 
the number of distinct physical states accessible to the system. A collection of m two-state 
systems has 2"* accessible states and can register m bits of information. In general, a 
system with N accessible states can register log2 N bits of information. But it has been 
known for more than a century that the number of accessible states of a physical system, 

is related to its thermodynamic entropy by the formula: S = AjbIuVF, where A;^ is 
Boltzmann's constant. (Although this formula is inscribed on Boltzmann's tomb, it is 
originally due to Planck: before the turn of the century, ks was often known as Planck's 
constant.) 
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The amount of information that can be registered by a physical system is / = 
S'(£')/A;_B ln2, where S{E) is the thermodynamic entropy of a system with expectation 
value for the energy E. Combining this formula with the formula 2E/'k% for the number 
of logical operations that can be performed per second, we see that when it is using all its 
memory, the number of operations per bit per second that our ultimate laptop can per- 
form is ks'^^T^'^E/TrhS oc kBT/%, where T = {dS/dE)~^ is the temperature of a kilogram 
of matter in a maximum entropy in a liter volume. The entropy governs the amount of 
information the system can register and the temperature governs the number of operations 
per bit per second it can perform. 

Since thermodynamic entropy effectively counts the number of bits available to a 
physical system, the following derivation of the memory space available to the ultimate 
laptop is based on a thermodynamic treatment of a kilogram of matter confined to a 
liter volume, in a maximum entropy state. Throughout this derivation, it is important 
to keep in mind that although the memory space available to the computer is given by 
the entropy of its thermal equilibrium state, the actual state of the ultimate laptop as 
it performs a computation is completely determined, so that its entropy remains always 
equal to zero. As above, we assume that we have complete control over the actual state of 
the ultimate laptop, and are able to guide it through its logical steps while insulating it 
from all uncontrolled degrees of freedom. As the following discussion will make clear, such 
complete control will be difficult to attain. 

2.1 Entropy, energy, and temperature 

In order to calculate the number of operations per second that could be performed 
by our ultimate laptop, we assumed that the expectation value of the energy was E. 
Accordingly, the total number of bits of memory space available to the computer is 
ln2, where S{E,V) is the thermodynamic entropy of a system with expec- 
tation value of the energy E confined to volume V. The entropy of a closed system is 
normally given by the so-called microcanonical ensemble, which fixes both the average 
energy and the spread in energy AE, and assigns equal probability to all states of the 
system within a range [E, E + AE]. In the case of the ultimate laptop, however, we wish 
to fix only the average energy, while letting the spread in energy vary according to whether 
the computer is to be more serial (fewer, faster gates, larger spread in energy) or parallel 
(more, slower gates, smaller spread in energy). Accordingly, the ensemble that should 
be used to calculate the thermodynamic entropy and the memory space available is the 
canonical ensemble, which maximizes S for fixed average energy with no constraint on the 
spread in energy AE. The canonical ensemble tells how many bits of memory are available 
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for all possible ways of programming the computer while keeping its average energy equal 
to E. In any given computation with average energy E the ultimate laptop will be in a 
pure state with some fixed spread of energy, and will explore only a small fraction of its 
memory space. 

In the canonical ensemble a state with energy Ei has probability = (l/Z(T))e~'^*/'^^^ 
where Z{T) = J2i e"'^*/'^^^ is the partition function, and the temperature T is chosen so 
that E = ^-piEi. The entropy is S = -ks^iPi^T^Pi = E/T + ks^T^Z. The number 
of bits of memory space available to the computer is S/ks^'^'^- The difference between 
the entropy as calculated using the canonical ensemble and that calculated using the mi- 
crocanonical ensemble is minimal. There is some subtlety involved in using the canonical 
ensemble rather than the more traditional microcanonical ensemble, however. The canon- 
ical ensemble is normally used for open systems that interact with a thermal bath at 
temperature T. In the case of the ultimate laptop, however, it is applied to a closed sys- 
tem to find the maximum entropy given a fixed expectation value for the energy. As a 
result, the temperature T = {dS/dE)~^ plays a somewhat difierent role in the context 
of physical limits of computation than it does in the case of an ordinary thermodynamic 
system interacting with a thermal bath. Integrating the relationship T = {dS/dE)~^ over 
E yields T = CE/S, where C is a constant of order unity (e.g., C = 4/3 for black-body 
radiation, C = 3/2 for an ideal gas, and C = 1/2 for a black hole). Accordingly, the 
temperature governs the number of operations per bit per second, kB ln2E/hS kBT/%, 
that a system can perform. As will become clear, the relationship between temperature 
and operations per bit per second is useful in investigating computation under extreme 
physical conditions. 

(Box: The role of thermodynamics in computation. The fact that entropy and 
information are intimately linked has been known since Maxwell introduced his famous 
'demon' well over a century ago^. Maxwell's demon is an hypothetical being that uses its 
information- processing ability to reduce the entropy of a gas. The first results in physics of 
information processing were derived in attempts to understand how Maxwell's demon could 
function^"^. The role of thermodynamics in computation has been repeatedly examined 
over the last half century. In the 1950's, von Neumann^° speculated that each logical 
operation performed in a computer at temperature T must dissipate energy A;BTln2, 
thereby increasing entropy by A;Bln2. This speculation proved to be false. The precise, 
correct statement of the role of entropy in computation was due to Landauer^, who showed 
that reversible, i.e. one-to-one, logical operations such as NOT can be performed without 
dissipation in principle, but that irreversible, many-to-one operations such as AND or 
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ERASE require dissipation at least A;^ ln2 for each bit of information fost. {ERASE is a 
one-bit fogical operation that takes a bit, or 1, and restores it to 0.) The argument behind 
Landauer's principle can be readily understood^^. Essentially, the one-to-one dynamics of 
Hamiltonian systems implies that when a bit is erased the information that it contains 
has to go somewhere. If the information goes into observable degrees of freedom of the 
computer, such as another bit, then it has not been erased but merely moved; but if it 
goes into unobservable degrees of freedom such as the microscopic motion of molecules it 
results in an increase of entropy of at least A;Bln2. 

In 1973, Bennett^®~^° showed that all computations could be performed using re- 
versible logical operations only. Consequently, by Landauer's principle, computation does 
not require dissipation. (Earlier work by Lecerf^^ had anticipated the possibility of re- 
versible computation, but not its physical implications. Reversible computation was dis- 
covered independently by Fredkin and Toffoli^-*^.) The energy used to perform a logical 
operation can be 'borrowed' from a store of free energy such as a battery, 'invested' in 
the logic gate that performs the operation, and returned to storage after the operation 
has been performed, with a net 'profit' in the form of processed information. Electronic 
circuits based on reversible logic have been built and exhibit considerable reductions in 
dissipation over conventional reversible circuits^^"^^. 

Under many circumstances it may prove useful to perform irreversible operations such 
as erasure. If our computer is subject to an error rate of e bits per second, for example, then 
error-correcting codes can be used to detect those errors and reject them to the environment 
at a dissipative cost of eA;BTEln2 joules per second, where Te is the temperature of the 
environment. ( A;BTln2 is the minimal amount of energy required to send a bit down 
an information channel with noise temperature T.^^) Such error-correcting routines in our 
ultimate computer function as working analogs of Maxwell's demon, getting information 
and using it to reduce entropy at an exchange rate of kBT\n2 joules per bit. In principle, 
computation does not require dissipation. In practice, however, any computer - even our 
ultimate laptop - will dissipate energy. 

The ultimate laptop must reject errors to the environment at a high rate to maintain 
reliable operation. To estimate the rate at which it can reject errors to the environment, 
assume that the computer encodes erroneous bits in the form of black-body radiation 
at the characteristic temperature 5.87 x 10^ K of the computer's memory.^^ The Stefan- 
Boltzmann law for black-body radiation then implies that the number of bits per unit area 
than can be sent out to the environment is B = 7r^k%T^/60 ln2^^c^ = 7.195 x 10^^ bits per 
meter^ per second. Since the ultimate laptop has a surface area of 10~^ square meters and 
is performing 10^° operations per second, it must have an error rate of less than 10~^° 
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per operation in order to avoid over-heating. Even if it achieves such an error rate, it must 
have an energy throughput (free energy in and thermal energy out) of 4.04 x 10^^ watts — 
turning over its own rest mass energy of mc^ ^ 10^^ joules in a nanosecond! The thermal 
load of correcting large numbers of errors clearly suggests the necessity of operating at a 
slower speed than the maximum allowed by the laws of physics. ) 

2.2 Calculating the maximum memory space 

To calculate exactly the maximum entropy for a kilogram of matter in a liter volume 
would require complete knowledge of the dynamics of elementary particles, quantum grav- 
ity, etc. We do not possess such knowledge. However, the maximum entropy can readily 
be estimated by a method reminiscent of that used to calculate thermodynamic quantities 
in the early universe®^. The idea is simple: model the volume occupied by the computer as 
a collection of modes of elementary particles with total average energy E. The maximum 
entropy is obtained by calculating the canonical ensemble over the modes. Here, we supply 
a simple derivation of the maximum memory space available to the ultimate laptop. A 
more detailed discussion of how to calculate the maximum amount of information that can 
be stored in a physical system can be found in the work of Bekenstein-^^"^-*^. 

For this calculation, assume that the only conserved quantities other than the com- 
puter's energy are angular momentum and electric charge, which we take to be zero. (One 
might also ask that baryon number be conserved, but as will be seen below, one of the 
processes that could take place within the computer is black hole formation and evap- 
oration, which does not conserve baryon number.) At a particular temperature T, the 
entropy is dominated by the contributions from particles with mass less than kBT/2c^. 
The £'th such species of particle contributes energy E = r£7T'^V{kBT)^/30?i^c^ and en- 
tropy S = 2rekBTr'^V{kBT)^ /45h^c^ = 4E/3T where rg is equal to the number of parti- 
cles/antiparticles in the species (i.e., 1 for photons, 2 for electrons/positrons) times the 
number of polarizations (2 for photons, 2 for electrons/positrons) times a factor that re- 
flects particle statistics (1 for bosons, 7/8 for fermions). As the formula for S in terms of 
T shows, each species contributes (27r)^r£/901n2 10^ bits of memory space per cubic 
thermal wavelength where Ay = 27rhc/kBT. Re-expressing the formula for entropy as 
a function of energy, our estimate for the maximum entropy is 

S = (4/3)A;B(7rVF/30n3c3)V4^3/4 ^ ^^3/, (2) 

where r = Note that S depends only insensitively on the total number of species 

with mass less than kBT/2c^. 
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A lower bound on the entropy can be obtained by assuming that energy and entropy 
are dominated by black body radiation consisting of photons. In this case, r = 2, and for a 
one kilogram computer confined to a volume of a liter we have ksT = 8.10 x 10"-^^ joules, or 
T = 5.87 X 10^ K. The entropy is S = 2.04 x 10^ joule/K, which corresponds to an amount of 
available memory space / = S/kB^T^'^ = 2.13x10^-'^ bits. When the ultimate laptop is using 
all its memory space it can perform 2\n.2kBE /ttUS = 3ln2kBT/27rh 10^^ operations 
per bit per second. As the number of operations per second 2E/'k% is independent of the 
number of bits available, the number of operations per bit per second can be increased 
by using a smaller number of bits. In keeping with the prescription that the ultimate 
laptop operates at the absolute limits given by physics, in what follows, we assume that 
all available bits are used. 

This estimate for the maximum entropy could be improved (and slightly increased) 
by adding more species of massless particles (neutrinos and gravitons) and by taking into 
effect the presence of electrons and positrons. Note that kBT/2c^ = 4.51 x 10~^^ kilograms, 
compared with the electron mass of 9.1 x lO"^-*^ kilograms. That is, our kilogram computer 
in a liter is close to a phase transition at which electrons and positrons are produced 
thermally. A more exact estimate of the maximum entropy and hence the available memory 
space would be straightforward to perform, but the details of such a calculation would 
detract from our general exposition, and could only serve to alter S slightly. S depends 
insensitively on the number of species of effectively massless particles: a change of r by a 
factor of 10, 000 serves only to increase 5 by a factor of 10. 

2.3 Comparison with current computers 

The amount of information that can be stored by the ultimate laptop, lO^-*^ bits, is 
much higher than the 10"^° bits stored on current laptops. This is because conventional 
laptops use many degrees of freedom to store a bit where the ultimate laptop uses just one. 
There are considerable advantages to using many degrees of freedom to store information, 
stability and controllability being perhaps the most important. Indeed, as the above 
calculation indicates, in order to take full advantage of the memory space available, the 
ultimate laptop must turn all its matter into energy. A typical state of the ultimate laptop's 
memory looks like a plasma at a billion degrees Kelvin: the laptop's memory looks like 
a thermonuclear explosion or a little piece of the Big Bang! Clearly, packaging issues 
alone make it unlikely that this limit can be obtained, even setting aside the difficulties of 
stability and control. 

Even though the ultimate physical limit to how much information can be stored in 
a kilogram of matter in a liter volume is unlikely to be attained, it may nonetheless be 
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possible to get a fair way along the road to such bit densities. In other words, the ultimate 
limits to memory space may prove easier to approach than the ultimate limits to speed. 
Following Moore's law, the density of bits in a computer has gone down from approximately 
one per cm^ fifty years ago to one per /im^ today, an improvement of a factor of 10^. It is not 
inconceivable that a similar improvement is possible over the course of the next fifty years. 
In particular, there is no physical reason why it should not be possible to store one bit 
of information per atom. Indeed, existing NMR and ion-trap quantum computers already 
store information on individual nuclei and atoms (typically in the states of individual 
nuclear spins or in hyperfine atomic states) . Solid-state NMR with high gradient fields or 
quantum optical techniques such as spectral hole-burning provide potential technologies 
for storing large quantities of information at the atomic scale. A kilogram of ordinary 
matter holds on the order of 10^^ nuclei. If a substantial fraction of these nuclei can be 
made to register a bit, then one can get quite close to the ultimate physical limit of memory 
without having to resort to thermonuclear explosions. If, in addition, one uses the natural 
electromagnetic interactions between nuclei and electrons in the matter to perform logical 
operations, one is limited to a rate of approximately 10-^^ operations per bit per second, 
yielding an overall information processing rate of ~ 10^° operations per second in ordinary 
matter. Although less than the fa 10^^ operations per second in the ultimate laptop, 
the maximum information processing rate in 'ordinary matter' is still quite respectable. 
Of course, even though such an 'ordinary matter' ultimate computer need not operate 
at nuclear energy levels, other problems remain: for example, the high number of bits 
still suggests substantial input/output problems. At an input/output rate of 10^^ bits 
per second, an Avogadro-scale computer with 10^^ bits would take about 10, 000 years 
to perform a serial read/write operation on the entire memory. Higher throughput and 
parallel input/output schemes are clearly required to take advantage of the entire memory 
space that physics makes available. 

3. Size limits parallelization 

Up until this point, we have assumed that our computer occupies a volume of a liter. 
The previous discussion, however, indicates that benefits are to be obtained by varying 
the volume to which the computer is confined. Generally speaking, if the computation to 
be performed is highly parallelizable or requires many bits of memory, the volume of the 
computer should be greater and the energy available to perform the computation should 
be spread out evenly amongst the different parts of the computer. Conversely, if the 
computation to be performed is highly serial and requires fewer bits of memory, the energy 
should be concentrated in particular parts of the computer. 
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A good measure of the degree of parallelization in a computer is the ratio between 
time it takes to communicate from one side of the computer to the other, and the average 
time it takes to perform a logical operation. The amount of time it takes to send a message 
from one side of a computer of radius R to the other is tcom = 2i?/c. The average time 
it takes a bit to flip in the ultimate laptop is the inverse of the number of operations per 
bit per second calculated above: tmp = 7r^5'/A;B21n2£'. Our measure of the degree of 
parallelization in the ultimate laptop is then 

^comAflip = kB4:ln2RE/7ThcS oc kBRT/Hc = 2ttR/Xt. (3) 

That is, the amount of time it takes to communicate from one side of the computer to the 
other, divided by the amount of time it takes to flip a bit, is approximately equal to the 
ratio between the size of the system and its thermal wavelength. For the ultimate laptop, 
with 2R = 10~^ meters, 2E/'Kh 10^^ operations per second, and 5'//cBln2 10^^ 
bits, tcom/^fiip ~ 10-'^°. The ultimate laptop is highly parallel. A greater degree of serial 
computation can be obtained at the cost of decreasing memory space by compressing the 
size of the computer or making the distribution of energy more uneven. As ordinary matter 
obeys the Beckenstein bound^°~^^, ksRE /ficS > l/27r, however, as one compresses the 
computer tcom/^flip ~ ksRE /ficS will remain greater than one: i.e., the operation will still 
be somewhat parallel. Only at the ultimate limit of compression — a black hole — is the 
computation entirely serial. 

3.1 Compressing the computer allows more serial computation 

Suppose that one wants to perform a highly serial computation on few bits. Then it 
is advantageous to compress the size of the computer so that it takes less time to send 
signals from one side of the computer to the other at the speed of light. As the computer 
gets smaller, keeping the energy fixed, the energy density inside the computer goes up. 
As the energy density in the computer goes up, different regimes in high energy physics 
are necessarily explored in the course of the computation. First the weak unification scale 
is reached, then the grand unification scale. Finally, as the linear size of the computer 
approaches its Schwarzchild radius, the Planck scale is reached. (No known technology 
could possibly achieve such compression.) At the Planck scale, gravitational effects and 
quantum effects are both important: the Compton wavelength of a particle of mass m, 
Ac = iTrTi/mc is on the order of its Schwarzschild radius, 2Gm/c^. In other words, 
to describe behavior at length scales of the size £p = sjUGjc^ = 1.616 X 10-35 meter, 
time scales tp = ^^hG/c^ = 5.391 x 10"^^ second, and mass scales of mp = 
2.177X IQ-^ kilograms, a unified theory of quantum gravity is required. We do not currently 
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possess such a theory. Nonetheless, although we do not know the exact number of bits 
that can be registered by a one kilogram computer confined to a volume of a liter, we do 
know the exact number of bits that can be registered by a one kilogram computer that has 
been compressed to the size of a black hole^°. This is because the entropy of a black hole 
has a well-defined value. 

In the following discussion, we use the properties of black holes to place limits on 
the speed, memory space, and degree of serial computation that could be approached by 
compressing a computer to the smallest possible size. Whether or not these limits could be 
attained, even in principle, is a question whose answer will have to await a unified theory 
of quantum gravity. (See Box 2) 

The Schwarzschild radius of a 1 kilogram computer is Rs = 2Gm/c^ = 1.485 x 10~^^ 
meters. The entropy of a black hole is Boltzmann's constant times its area divided by 4, 
as measured in Planck units. Accordingly, the amount of information that can be stored 
in a black hole is / = AttGiv? / ln2hc = 47rm^/ln2mp. The amount of information that 
can be stored by the 1 kilogram computer in the black-hole limit is 3.827 x 10^^ bits. A 
computer compressed to the size of a black hole can perform 5.4258 x 10^° operations per 
second, the same as the 1 liter computer. 

In a computer that has been compressed to its Schwarzschild radius, the energy per 
bit is E/I = mc^/I = \n2hc^/47rmG = ln2/cBT/2, where T = (dS/dE)-'^ = fic/ATrkBRs 
is the temperature of the Hawking radiation emitted by the hole. As a result, the time it 
takes to flip a bit on average is tflip = ttUI /2E = 7r^i?5/cln2. In other words, according 
to a distant observer, the amount of time it takes to flip a bit, tfHp, is on the same order 
as the amount of time tcom = t^Rs /c it takes to communicate from one side of the hole to 
the other by going around the horizon: tcom/^flip = ln2/7r . In contrast to computation 
at lesser densities, which is highly parallel as noted above, computation at the horizon of 
a black hole is highly serial: every bit is essentially connected to every other bit over the 
course of a single logic operation. As noted above, the serial nature of computation at 
the black-hole limit can be deduced from the fact that black holes attain the Beckenstein 
bound20-22, kBRE/hcS = l/27r. 

(Box 2: Can a black hole compute? 

No information can escape from a classical black hole: what goes in does not come 
out. The quantum mechanical picture of a black hole is different, however. First of all, 
black holes are not quite black: they radiate at the Hawking temperature. T given above. 
In addition, the well-known statement that 'a black hole has no hair' — i.e., from a distance 
all black holes with the same charge and angular momentum look essentially alike — is 
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now known to be not always true^ Finally, recent work in string tlieory^^~^° suggests 
that black holes do not actually destroy the information about how they were formed, but 
instead process it and emit the processed information as part of the Hawking radition as 
they evaporate: what does in does come out, but in an altered form. 

If the latter picture is correct, then black holes could in principle be 'programmed': 
one forms a black hole whose initial conditions encode the information to be processed, 
lets that information be processed by the Planckian dynamics at the hole's horizon, and 
gets out the answer to the computation by examining the correlations in the Hawking 
radiation emitted when the hole evaporates. Despite our lack of knowledge of the precise 
details of what happens when a black hole forms and evaporates (a full account must await 
a more exact treatment using whatever theory of quantum gravity and matter turns out 
to be the correct one), we can still provide a rough estimate how much information is 
processed during this computation. Using Page's results on the rate of evaporation of a 
black hole^®, we obtain a lifetime for the hole tnte = G^m^ /3Chc^, where C is a constant 
that is depends on the number of species of particles with a mass less than ksT, where T is 
the temperature of the hole. For 0(10^ — 10^) such species, C is on the order of 10~^ — 10~^, 
leading to a lifetime for a 1 kilogram black hole of fa 10~^^ seconds, during which time the 
hole can perform 10^^ operations on its lO-*^^ bits. As the actual number of effectively 
massless particles at the Hawking temperature of a one-kilogram black hole is likely to be 
considerably larger than 10^, this number should be regarded as an upper bound on the 
actual number of operations that could be performed by the hole. Interestingly, although 
this hypothetical computation is performed at ultra-high densities and speeds, the total 
number of bits available to be processed is not far from the number available to current 
computers operating in more familiar surroundings. ) 

4. Constructing ultimate computers 

Throughout this entire discussion of the physical limits to computation, no mention 
has been made of how to construct a computer that operates at those limits. In fact, 
contemporary quantum 'microcomputers' such as those constructed using nuclear magnetic 
resonance do indeed operate at the limits of speed and memory space described above. 
Information is stored on nuclear spins, with one spin registering one bit. The time it takes 
a bit to flip from a state | t) to an orthogonal state | I) is given by ttU/^iiB = 7rh/2E, 
where fj, is the spin's magnetic moment, B is the magnetic field, and E = jiB is the average 
energy of interaction between the spin and the magnetic field. To perform a quantum logic 
operation between two spins takes a time TTfi/2E,^, where E,^ is the energy of interaction 
between the two spins. 
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Although NMR quantum computers aheady operate at the hmits to computation set 
by physics, they are nonetheless much slower and process much less information than the 
ultimate laptop described above. This is because their energy is largely locked up in mass, 
thereby limiting both their speed and their memory. Unlocking this energy is of course 
possible, as a thermonuclear explosion indicates. Controlling such an 'unlocked' system 
is another question, however. In discussing the computational power of physical systems 
in which all energy is put to use, we assumed that such control is possible in principle, 
although it is certainly not possible in current practice. All current designs for quantum 
computers operate at low energy levels and temperatures, exactly so that precise control 
can be exerted on their parts. 

As the discussion of error correction above indicates, the rate at which errors can 
be detected and rejected to the environment by error correction routines puts a funda- 
mental limit on the rate at which errors can be committed. Suppose that each logical 
operation performed by the ultimate computer has a probability e of being erroneous. The 
total number of errors committed by the ultimate computer per second is then 2eE/7rh. 
The maximum rate at which information can be rejected to the environment is, up to 
a geometric factor, \n2cS/R (all bits in the computer moving outward at the speed of 
light). Accordingly, the maximum error rate that the ultimate computer can tolerate is 
e < 7rln2hcS/2ER = 2tflip/tcom- That is, the maximum error rate that can be tolerated 
by the ultimate computer is the inverse of its degree of parallelization. 

Suppose that control of highly energetic systems were to become possible. Then how 
might these systems be made to compute? As an example of a 'computation' that might be 
performed at extreme conditions, consider a heavy-ion collision that takes place in heavy- 
ion collider at Brookhaven^^. If one collides 100 on 100 nucleons at 200 GeV per nucleon, 
the operation time is 7rh/2E 10~^^ seconds. The maximum entropy can be estimated to 
be approximately to be 4 per relativistic pion (to within a factor of less than 2 associated 
with the overall production rate per mesons) of which there are approximately 10^ per 
central collision in which only a few tens of nucleons are spectators. Accordingly, the total 
amount of memory space available is S/kB^'^2 ^ 10^ — 10^ bits. The collision time is 
short: in the center of mass frame the two nuclei are Lorentz contracted to D/7 where 
D = 12 — 13 fermi and 7 = 100, giving a total collision time of fa 10~^^ seconds. During 
the collision, then, there is time to perform approximately 10^ operations on 10^ bits — 
a relatively simple computation. (The fact that only one operation per bit is performed 
suggests that there is insuflficient time to reach thermal equilibrium, an observation that 
is confirmed by detailed simulations.) The heavy ion system could be programmed by 
manipulating and preparing the initial momenta and internal nuclear states of the ions. 
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Of course, one does not expect to be able do word processing on such a 'computer.' Rather 
one expects to uncover basic knowledge about nuclear collisions and quark-gluon plasmas: 
in the words of Heinz Pagels, the plasma 'computes itself. '^^ 

At the greater extremes of a black hole computer, we assumed that whatever theory 
(string theory, M theory?) turns out to be the correct theory of quantum matter and 
gravity, it is possible to prepare initial states of such systems that causes their natural time 
evolution to carry out a computation. What assurance do we have that such preparations 
exist, even in principle? 

Physical systems that can be programmed to perform arbitrary digital computations 
are called computationally universal. Although computational universality might at first 
seem to be a stringent demand on a physical system, a wide variety of physical systems 
— ranging from nearest neighbor Ising models^^ to quantum electrodynamics®^ and con- 
formal field theories®^ — are known to be computationally universal^-*^"^^'^^"^^. Indeed, 
computational universality seems to be the rule rather than the exception. Essentially 
any quantum system that admits controllable nonlinear interactions can be shown to be 
computationally universal^^"^-*^ . For example, the ordinary electrostatic interaction be- 
tween two charged particles can be used to perform universal quantum logic operations 
between two quantum bits. A bit is registered by the presence or absence of a particle 
in a mode. The strength of the interaction between the particles, e^/r, determines the 
amount of time tfUp = irTir /2e^ it takes to perform a quantum logic operation such as a 
Controlled- A'"OT on the two particles. Interestingly, the time it takes to perform such an 
operation divided by the amount of time it takes to send a signal at the speed of light 
between the bits tcom = r/c is a universal constant, t//ip/tcom = 7r^c/2e^ = TT/2a, where 
a = /%c 1/137 is the fine structure constant. This example shows the degree to which 
the laws of physics and the limits to computation are entwined. 

In addition to the theoretical evidence that most systems are computationally univer- 
sal, the computer on which I am writing this article provides strong experimental evidence 
that whatever the correct underlying theory of physics is, it supports universal computa- 
tion. Whether or not it is possible to make computation take place in the extreme regimes 
envisaged in this paper is an open question. The answer to this question lies in future 
technological development, which is difficult to predict. If, as seems highly unlikely, it is 
possible to extrapolate the exponential progress of Moore's law into the future, then it 
will only take two hundred and fifty years to make up the forty orders of magnitude in 
performance between current computers that perform 10^° operations per second on 10^° 
bits and our one kilogram ultimate laptop that performs 10^-*^ operations per second on 
10^1 bits. 
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Figure 1: The Ultimate Laptop 

The 'ultimate laptop' is a computer with a mass of one kilogram and a volume of one 
liter, operating at the fundamental limits of speed and memory capacity fixed by physics. 
The ultimate laptop performs 2m(?' /ttU = 5.4258 x 10^° logical operations per second on 
10^^ bits. Although its computational machinery is in fact in a highly specified physical 
state with zero entropy, while it performs a computation that uses all its resources of 
energy and memory space it appears to an outside observer to be in a thermal state at 
^ 10^ degrees Kelvin. The ultimate laptop looks like a small piece of the Big Bang. 

Figure 2: Computing at the Black-Hole Limit 

The rate at which the components of a computer can communicate is limited by 
the speed of light. In the ultimate laptop, each bit can flip ^ 10^^ times per second, 
while the time to communicate from one side of the one liter computer to the other is 
on the order of 10^ seconds: the ultimate laptop is highly parallel. The computation can 
be speeded up and made more serial by compressing the computer. But no computer 
can be compressed to smaller than its Schwarzschild radius without becoming a black 
hole. A one-kilogram computer that has been compressed to the black hole limit of Rs = 
2Gm/c^ — 1.485 x 10~^^ meters can perform 5.4258 x 10^^ operations per second on its 
/ = AnGm^ / ln2^c = 3.827 x 10^^ bits. At the black-hole limit, computation is fully serial: 
the time it takes to flip a bit and the time it takes a signal to communicate around the 
horizon of the hole are the same. 
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